>~ t We claim: 




1 . \ In a computerized spreadsheet which includes multiple spreadsheet cells, a 
method for testing a first spreadsheet cell containing a first formula, the method comprising: 
creating V first formula graph for the first formula of the first spreadsheet cell, the first 
5 formula graph containing nodes representing predicates and definitions in the first formula of 
the first spreadsheetycell and edges representing execution flow between the nodes of the first 
formula graph; 

collecting one oV more du-associations for the first spreadsheet cell, where each du- 
association relates a nodevin a second formula graph for a second formula of a second 
10 spreadsheet cell with one o^ a node or edge in the first formula graph of the first spreadsheet 
cell; 

tracking an execution tr^ace for the first spreadsheet cell, where the execution trace 
comprises a sequence of nodes in the first formula graph of the first spreadsheet cell and a set 
of edges from the first formula graph connecting pairs of the nodes in the execution trace 
15 sequence; and \ . 

after receiving a user validation of the first spreadsheet cell, marking as exercised the 
du-associations containing a node or edge in the execution trace for the first spreadsheet cell. 



2. A method according to claim 1 further comprising repeating the steps of 

\ 

20 creating, collecting, tracking, and marking ft>r each second spreadsheet cell with an exercised 
du-association so that any du-associations fo^ach second spreadsheet cell are marked as 
exercised after at least one of the first spreadsheet cell and second spreadsheet cell has been 
user- validated. 



25 3. In a computerized spreadsheet containing a plurality of spreadsheet cells, a 

method for testing a first spreadsheet cell containing ^formula, the method comprising: 
collecting one or more test elements for the firstW>readsheet cell; 
tracking an execution trace of the first spreadsheet cell; and 

marking as exercised a subset of the test elements ^hat participated in the execution 
30 trace for the first spreadsheet cell. 
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4. ^ A method according to claim 3 further comprising: 

identifying all other spreadsheet cells upon which the first spreadsheet cell depends; 
and \ 

for each other spreadsheet cell, repeating the steps of collecting, tracking, and 
5 marking. 

5. A method according to claim 3 wherein collecting one or more test elements 
includes collecting one or more du-associatipns for the first spreadsheet cell. 

10 6. A methoa according to claim 5 wherein one or more du-associations are 

collected as the formula i§ entered into the first spreadsheet cell. 

7. A method according to claim 5 wherein collecting one or more du-associations 
includes: 

15 identifying all other cells used in the formula of the first spreadsheet cell; 

identifying all definitions^of the other cells that are used in the formula of the first 
spreadsheet cell; and 

creating a du-association befWeen each definition of the other cells and each use of the 
definition in the formula of the first spreadsheet celL 



20 



8. A method according to claim 3 wherein tracking an execution trace includes 
tracking which parts of the formula fot-tw first spreadsheet cell have been exercised. 

9. A method according to claiiA 8 wherein marking as exercised a subset of the 
25 test elements includes marking du-associations for the first spreadsheet cell that were 

exercised by the execution trace for the first spreadsheet cell, where each du-association 
includes a definition of a second cell and a use of the definition of the second cell in the 
formula for the first spreadsheet cell. 
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10.\ A method according to claim 9 wherein marking du-associations includes 
marking as Socercised each du-association whose use is part of the formula for the first 
spreadsheet cell that has been executed. 



10 



1 1 . A method according to claim 3 wherein marking as exercised a subset of the 
test elements includes: 

receiving ac^ser validation of the first spreadsheet cell; and 

after receiving, the user validation of the first spreadsheet cell, marking as exercised 
the subset of test elements that participated in the execution trace for the first spreadsheet 
cell. 



12. A method according to claim 1 1 further comprising: 

identifying all other spreadsheet cells upon which the first spreadsheet cell depends; 



and 



15 for each other spreadsheet cell, repeating the steps of collecting, tracking, and 

marking so that any test elements Vor each other spreadsheet cell are marked as exercised 
independently of whether each othet spreadsheet cell has been user- validated. 



20 



13. A method according to Maim 1 1 wherein receiving a user validation includes 
having a user click on a validation tab for the first spreadsheet cell. 



25 



14. A method according to clairfo 1 1 wherein receiving a user validation includes: 
storing a validation symbol for the first spreadsheet cell; and 
displaying the validation symbol for thfe first spreadsheet cell. 



15. A method according to claim 14 Wherein displaying the validation symbol 
includes displaying the validation symbol for the fi^rst spreadsheet cell in a validation tab. 



30 
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16V A method according to claim 3 further comprising: 
discarding the test elements for the first spreadsheet cell after a user changes the 
formula for the first spreadsheet cell; and 

repeating the steps of collecting, tracking, and marking for the first spreadsheet cell. 



17. A method according to claim 16 wherein discarding the test elements for the 
first spreadsheet c\ell includes: 



identifying all other cells in the spreadsheet that depend on the first spreadsheet cell; 



and 



10 marking as unexercised all test elements for the identified cells that use a definition of 

the first spreadsheet cell. 



15 



18. A method according to claim 17 wherein marking as unexercised all test 
elements for the identified cells includes invalidating a user validation for the identified cells. 



19. A method accordmg to claim 18 wherein invalidating a user validation 
includes changing a validation syrnbol representing a validated spreadsheet cell for the 
identified cells to a validation symbOd representing uncertainty for the identified cells. 



20 20. A method according to claim 19 wherein invalidating a user validation 

includes displaying the validation symbom-epresenting uncertainty for the identified cells. 



25 



21 . A method according to claim \20 wherein displaying the changed validation 
symbol includes displaying the validation symbol representing uncertainty for the identified 
cells in a validation tab. 



30 



22. A method according to claim 19 wlferein: 
the validation symbol representing a validated spreadsheet cell is a checkmark; and 
the validation symbol representing uncertaintAis a question mark. 
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2\ A method according to claim 18 wherein invalidating a user validation 
includes rekioving a validation symbol representing a validated spreadsheet cell for the 
identified celjs. 

5 24. \ method according to claim 16 wherein discarding the test elements for the 

first spreadsheet {fell includes invalidating a user validation for the first spreadsheet cell. 

25. A method according to claim 24 wherein invalidating a user validation 
includes removing a validation symbol representing a validated spreadsheet cell for the first 

1 0 spreadsheet cell . 

26. A method ai\cording to claim 25 wherein: 

the validation symbo\representing a validated spreadsheet cell is a checkmark. 



to 1 5 27. A method according to claim 3 further comprising marking as unexercised a 

J* subset of the test elements for theNfirst spreadsheet cell that are affected by a change in the 

H 5 formula for the first spreadsheet cel\ 

28. A method according to cdaim 3 further comprising providing the user with an 
20 indication of whether the first spreadsheet cell has been completely tested. 

29. A method according to clain\3 further comprising providing the user with an 
indication of how completely the first spreadsheet cell has been tested. 

25 30. A method according to claim 3, wherein the test elements are chosen from the 

group consisting of du-associations, node identifications, edge identifications, and cell 
identifications. 



31. A method according to claim 3 furtherVomprising selecting the first 
30 spreadsheet cell from the plurality of spreadsheet cells. 
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32. In a computerized spreadsheet containing a plurality of spreadsheet cells, a 
method for batch-collecting one or more test elements for a group of spreadsheet cells 
containing formulae tmfacilitate testing a first spreadsheet cell, the method comprising: 
identifying all thfe spreadsheet cells upon which the group depends; and 
collecting one or more test elements for each spreadsheet cell that depends upon an 
identified cell or the group ck* spreadsheet cells. 



10 
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33. In a computerized spreadsheet, a method for providing a user with an 
indication of how completely tested a spreadsheet cell is, the method comprising: 

maintaining a set of test elements for the spreadsheet cell; 

identifying a subset of the setW test elements that have been exercised; 

using the set of test elements anci the subset of the set k calculating a testedness 
measure of test elements that have been ekercised; 

providing the user with an indication of the testednefcs measure. 



I; and V\ 
^stedness meas 



34. A method according to claim 33vwherein providing the user with an indication 
of the testedness measure includes providing the\iser with visual feedback of the testedness 
measure. 



20 35. A method according to claim 34 wherein providing the user with visual 

feedback includes coloring a border of the spreadsheet\cell, where the color chosen indicates 
the testedness measure. 

36. A method according to claim 35 wherein tnb color chosen to indicate the 
25 testedness measure varies between red and blue, the color red representing a 0% testedness 
percentage and the color blue representing a 100% testedness percentage. 



30 



37. A method according to claim 33 further including updating the indication of 
the testedness measure as the testedness measure changes. 
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38. In\a computerized spreadsheet, a method for providing a user with an 
indication of how completely tested a spreadsheet cell is, the method comprising: 
maintaining a test element for the spreadsheet cell; 

calculating a testedness measure of the test element for the spreadsheet cell; and 
providing the u\er with an indication of the testedness measure of the test element for 
the spreadsheet cell. 



39. A method according to claim 38 wherein providing the user with an indication 
of the testedness measure orahe test element for the spreadsheet cell includes providing the 
user with visual feedback of the testedness measure of the test element for the spreadsheet 
cell. 



40. A method according to claim 39-wt^rein providing the user with visual 
feedback of the testedness measureV>f the test elei jient for the spreadsheet cell includes 
coloring an arrow representing the t^st element for the spreadsheet cell, where the color 
chosen indicates the testedness measure. 



41. A method according to claim 40 wherein the color chosen to indicate the 
testedness measure varies between red and blue, the color red representing a 0% testedness 
percentage and the color blue representing a 100% testedness percentage. 

V 

42. A method according to claim 18 further including updating the indication of 
the testedness measure as the testedness measufe changes. 



43. A computer-readable medium containing a testing program to support testing, 
in a computerized spreadsheet, a spreadsheet cell containing a formula, the testing program 
comprising: 

a test element data structure for storing a set o^one or more test elements for the 
spreadsheet cell; 

a trace data structure for storing an execution trafce of the spreadsheet cell; and 
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a subroutine operable to software marlifi exercised any test elements that participated 



in the execution trace. 



bC7 \ 

\^ / 44. I A testing program according to claim 43 further comprising a subroutine 
operable to update the test element data structure as the formula for the spreadsheet cell 
changes. 



45. A testing program according to claim 43 further comprising a subroutine 
operable to update t-he trace data structure as any cell upon which the spreadsheet cell 
depends changes. 

46. A testing program according to claim 43 further comprising: 
a subroutine operable to identify all other spreadsheet cells upon which the 

spreadsheet cell depends; and 

a subroutine operablp to update the test element data structure for each other 
spreadsheet cell. 

47. A testing program according to claim 43 wherein each test element includes: 
a definition reference to a definition of a second cell; 

a use reference to a use oi\the definition referenced the second cell in the formula of 
the spreadsheet cell; and 

a du-association between the\definition reference and the use reference. 

48. A testing program according to claim 43 further comprising a validation 
structure that allows a user to mark the spreadsheet cell as validated. 

49. A testing program according to claim 48 wherein the validation structure 
changes from a checkmark to a question masjk when the formula of the spreadsheet cell 
changes. 
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50. \ A testing program according to claim 48 wherein the validation structure 
changes frorn a checkmark to a blank when the formula of the spreadsheet cell changes. 



10 



15 



5 1 . A system for testing a spreadsheet cell in a spreadsheet on a computer system, 
the system comprising: 

a set of one or more test elements for the spreadsheet cell; 

an execution trace of the spreadsheet cell; and — 
a marking unit\o mark as exercised test elements that participated in the execution 

trace. 

52. A system according to claim 51 further comprising: 
a dependency identification unit to identify all other spreadsheet cells upon which the 

spreadsheet cell depends; anc 

a test element update u^it to update the test element data structure for each other 
spreadsheet cell. 
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53. A system accordingVo claim 51 wherein each test element includes: 

a definition reference to a definition of a second cell; 

\ / 

a use reference to a use of the definition reference of the second cell in the formula of 
the spreadsheet cell; and 

a du-association between the definition reference and the use reference. 



25 



54. A system according to claim ©1 further comprising a validation structure that 
allows a user to mark the spreadsheet cell as Validated. 

55. A system according to claim 54 wherein the validation structure is constructed 
and arranged to change from a checkmark to a question mark when the formula of the 
spreadsheet cell changes. 
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